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SPECIFICATION 




INTERCONNECTION LINK REDUNDANCY 
IN A MODULAR SWITCH NODE 

FIELD OF THE INVENTION 

This invention relates to ATM switches, and more 
5 particularly to interconnection link redundancy within an ATM 
node. 

BACKGROUND AND SUMMARY OF THE INVENTION 

ATM based telecommunications networks are arranged with 
a number of ATM switch nodes communicating with one another. 
A design and structure of switch nodes are well known and may 
take a variety of different forms. As the switch nodes become 
increasingly large in terms of their capacity to handle data, the 
physical structure for the node may (and likely will) exceed one 
physical switch module of boards (for example, one rack). Thus, 
for many telecommunication nodes, the physical infrastructure for 
the node is often based on several physical switch modules, each 
containing a number of boards. The modules communicate with 
one another via internal links such that the entire system of 
modules acts as a single cohesive node unit. The reliability of the 
interconnection links between the several modules in such a large 
node is crucial. If any link fails between the number of modules, 
the entire operation of the node is jeopardized. Accordingly, 
physical redundancy in the interconnection links between modules 
within a node is preferable. 
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number of methods for link redundancy are present on the 
market fihat require the applications running at the node to closely 
participate in any changeover process from a first link to a 
redundanasecond one. Thus, as shown in Figure 2, switch node is 
viewed as a number of layers ranging from, in the example of 
Figure 2, power distribution in the bottom layer 28 up to network 
layer routing Vnd/or connection termination functions with 
application processing in the upper layer 20. The problem 
commonly associated with the prior art is that the upper layers (20) 
that run an application are involved in a changeover process from 
one interconnection link to another (at layer 22). Redundancy 
operations at layer 22 should occur independently, as much as 
possible, of the operations of the application in layer 20. If 
possible, redundancy changeovers at layer 22 should have no or 
very small interaction vMh other layers in Figure 2. 
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Thk present invention isolates the interconnection link 
redundancyJayer by means of specific methods for re-routing of 
traffic flows,\either packets or cells, from a failed first 
interconnection link to another redundant such link between 
interconnected switch modules, without any involvement of 
functions in the Higher layer. When a connection is set up, a state 
condition is deterrmned as to "which one within a pair of switch 
module interconnection links is the primary link over which the 
packet flow on the connection shall be routed. A corresponding 
routing tag is then attached to each packet on the node-internal 
connection. If the state df the selected interconnection links 
changes to a non-operational state, the packet routing will be 



changed by means of changing the translation of the routing tag 
withiA the interconnection link layer so that the packets will be 
forwaraed via the secondary link." 

With the present invention, interconnection link redundancy 
is obtained with minimal interaction to the application layer. 

These, as well as other objects and advantages of this 
invention, will be more completely understood and appreciated by 
careful study of the following more detailed description of a 
presently preferred exemplary embodiment of the invention taken 
in conjunction with the accompanying drawings, of which: 

BRIEF DESCRIPTION OF THE DRAWINGS 

FIGURE 1 is a schematic diagram of an example of a 
telecommunications network; 

FIGURE 2 is a schematic representation of a switch node 
redundancy layering; 

FIGURE 3 is a schematic diagram of a switch node in 
accordance with an example embodiment of the present invention; 

FIGURES 4, 4A, and 5 are example embodiments of switch 
modules in accordance with the present invention; and 

FIGURE 6 is a schematic diagram of various switch 
modules in accordance with another example embodiment of the 
present invention. 




DETAILED DESCRIPTION OF THE PRESENTLY 
PREFERRED EMBODIMENT 

Figure 1 illustrates an example embodiment of the 
telecommunications system, within which the present invention 
5 may be employed. Telecommunications system 10 includes a 
number of switch nodes A-E communicating with each other 
through various communication paths. Switch nodes A, B 5 D, and 
E provide access points for external devices and networks, such as 
LAN hub 16, PBX 18, Internet 12, host 20, wireless 

10 telecommunications network 14, etc. Of course, many other types 
of external devices and networks may be associated with the 
network as a whole by simply adding additional switch nodes or 
by linking them to one of the pre-existing switch nodes. The 
present invention is not meant to be limited to the embodiment of 

15 Figure 1, but such embodiment is shown to provide an example 
application in which the present invention may be embodied. 

The present invention could be employed in any one of the 
switch nodes A-E of Figure 1. As switch node A, for example, 
increases in size (meaning that its capacity to handle data from 

20 LAN hub 16, PBX 18, or new external devices increases), the 
physical structure of switch node A will begin to exceed the 
practical capacity of a physical rack. In such a case, the switch 
node A is typically divided into two modules communicating with 
each other. Together, the two modules then comprise the switch 

25 node A. Further division can also be envisioned (and frequently 
occurs) such that one switch node may comprise a number of 



switch modules communicating one with the others via internal 
switch node links. 

Figure 3 illustrates an example embodiment of such a two 
module system. There, switch node 30 includes switch module 31 
5 and switch module 32. Switch module 31 includes a certain 
number of device boards (DEVI, DEV2. . . DEVn) 35 
communicating with a switch core 36. The device boards are for 
application processing and/or node external interfaces. On the 
other end of the switch core 36 is a link termination board (LTal) 

10 37 communicating with Link A 33. Link 33 is a switch module 
interconnection link in accordance with the present invention. 
Since switch module 31 and switch module 32 must communicate 
with each other in order to coherently form together the switch 
node, it is imperative that link 33 be secure. For that reason, a 

15 second link 34 (link R) is provided between switch module 31 and 
switch module 32 to guarantee operation in the event Link 33 
fails. To service Link 34, link termination board 38 is included 
within switch module 31 to communicate with switch core 36. 

In the same way, switch module 32 includes link 
20 termination board 39, redundant link termination board 40, switch 
core 41, and a number of device boards DEVI, DEV2. . .DEVn 42. 

Note that although the present embodiment described in 
Figure 3 shows a one-plus-one system, that is a system in which 
one redundant link 34 is provided for each link 33, the present 
25 invention could also be employed in a link redundancy system 
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using a n-plus-one or n-plus-m principle, meaning that one or a set 
of common redundant links is used to service a number of links. 

Further, the present invention is sometimes described herein 
will reference to "cell" processing, but the invention applies 
equally well to data packets of variable lengths and to any other 
data unit switched by the switch core provided the node-internal 
routing of the data unit over the interconnection links is controlled 
by a routing tag which can be modified as described. 

1 switch module 31 and 32 can be viewed in terms of its 
10 layeringXas shown in Figure 2. In the example embodiment of 
Figure 2, the lowest layer of switch module 31 is power 
distribution\28. Moving up from the power distribution layer 28, 
one would find, in order, clock functions 26, ATM switch planes 
24, interconnection links 22, and network layer routing and 
|/QK termination devices 20. Ideally, each of the layers 20-28 includes 
its own redundancy which is as independent as possible from other 
layers. Thus, as shown in Figure 2, power distribution layer 28 is 
redundancy terminated (e.g., via diodes), if possible with 
supervision. Redundancy operations for layer 28 will detect a 
20 faulty timer unit or clock reference and will change the unit or 
reference source when needed. For layer 24, the redundancy 
operation detects a faulty switch plane and redirects devices to 
another plane. Thus, one can see in Figure 3, a number of switch 
planes for switch core 36 witnythe switch planes being redundant 
25 to each other for secure operation! of layer 24. At layer 22, the 
redundancy termination of the interconnection links is as 
described in the present invention herein. Specifically, layer 22 



recmndancy operates to detect a faulty link and re-direct devices to 
anomer link. As described above, ideally the network layer 
routing and termination devices redundancy terminations should 
be inafependent of the layers 22-28, to the greatest extent possible. 

Ideally, each layer should be as orthogonal as possible to all 
others. As an example, if power distribution to a module is fed via 
the switch boards that also interconnect exchange terminals, then a 
redundancy termination relationship exists that must be handled 
properly in the system. 

The present invention focuses primarily on the 
interconnection link redundancy at layer 22. When link faults are 
discovered using traditional STM/SDH level alarms LOS, AIS, 
RAI, etc., the present invention re-routes data flow between the 
switch modules via the alternative physical connection link. 
Routine testing running in the background over the links 33 and 
34 can also be used in addition to the traditional STM/SDH level 
alarms to discover all link faults, although such routine testing will 
result in a longer fault period before discovery than the traditional 
STM/SDH level alarms. 

Referring now to Figures 4 and 5, the routing system in 
accordance with an example embodiment of the present invention 
is described. In Figure 4, the ingress of data packets onto links 33 
and 34 are described. In Figure 5, the egress of data packets from 
links 33 and 34 is described. 



In Figure 4, a switch module, such as switch module 3 1 
(Figure 3) is shown composed of device boards 35 communicating 



with switch core 36 to link terminations 37 and 38. When a 
connection is set up, the connection is configured as normal on the 
device boards 35 using, for example, data packet routing tag "a" 
when Link A 33 is intended for use (in normal circumstances). 
5 The connection is configured on both of the link terminations 37 
and 38 with the same switch segment VCI and the same link 
segment VPI/VCL The link terminations 37 and 38 include 
Switch Port Interface Modules (SPIM) communicating with the 
switch core 36. Also, ATM lay er modules ALM communicate 
10 with line termination modules LTM, which provide data packets 
streams to the respective links 33 and 34. 

The switch port interface modules SPIM of the link 
termination boards 37 and 38 are informed of all changes in the 
current link 33 or 34 being used. That is, in normal operation, link 

15 A33 may be the current link of choice, such that both SPIMs of 
link termination 37 and link termination 38 know that all data 
packets will run between switch modules 31 and 32 via link 33. 
When link 33 fails, the dual link state is changed to define the 
other link 34 as the active link and the SPIMs of the link 

20 terminations 37 and 38 and of the device boards 35 are informed 
of the state change. 

Thus, when the data packets with data packets routing tag 
"a" is sent through switch core 36 by device 35, it is translated by 
ingress SPIM to either the al position shown in Figure 4 or the a2 
25 position shown in Figure 4, depending on the dual link state 

information known by the SPIMs. Thus, in normal operation, data 
packets routing tag "a" is sent through switch core 36 to link 



termination 37 and/or 38. Note that the SPIM can operate in 
alternating embodiments: first, where tag "a" is used to send data 
packets to both link terminations 37 and 38 (multi-cast mode) or to 
only the active termination 37 or 38 (uni-cast mode). The 
5 advantage of the latter embodiment is: by only sending the data 
packets to the first link A and not to the second link B, the switch 
core does not need to support multi-cast. The support of multi- 
cast functions in a switch core is in some cases difficult and puts 
higher requirements on the capacity of the switch since data 

10 packets are duplicated. In most cases the most appropriate 

position of a routing tag translation table to perform the routing 
tag addition/translation described above is at the ingress to the 
switch, i.e., at the "a" close to 35. The content of the routing tag 
translation table at "a" will be changed to redirect the data packets 

15 to link B at the detection of a fault in link A. Up until that time no 
data packets are sent to the link B port, i.e., the SPIM in 38. 

In the multi-cast mode, SPIM of link termination board 38 
receives and blocks further progress of the data packet, while 
SPIM of link termination board 37 provides the data packet to the 

20 ATM layer module ALM (for ultimate application to link 33). 
When link 33 fails, link 34 becomes the active communication 
link between switch module 31 and 32, such that SPIM 37 no 
longer applies the data packets from devices 35 to the point al, 
while SPIM of link termination board 38 provides the data packets 

25 to point a2. 

In Figure 4 A, the switch module is similar to that of Figure 
4 except that the "a" tag routing functions are located in the switch 




core 36' rather than on devices 35. Otherwise elements identified 
by a "prime" are similarly operating in Figure 4A as described 
with respect to their counterpart numbers in Figure 4. In other 
words, Figures 4 and 4A illustrate that the routing tag translation 
5 function can be in the SPIMs or in the switch core. 

In Figure 4A, and with the switch operating in uni-cast 
mode, the following applies: when the dual link state is changed 
the routing tag translation functions in the switch core are 
informed so that they can change the tag translation from the 
10 devices as required. 

When operating in the multi-cast mode the "a" function will 
continuously duplicate the data packets to both the "al" and the 
"a2" destinations and the SPIMs on exchange 37' and 38' will 
either transmit or discard the data packets depending on the active 
15 or stand-by state of the links A33' and B34'. 

Thus, the devices 35' send data packets with tag "a" and the 
SPIMs of the link termination boards (in the uni-cast mode) or the 
"a" re-direction function of the switch core (in the uni-cast mode) 
determine which of the link A33' or B34' that is used. In either 
20 multi-cast or uni-cast mode, to the devices 35', the dual linking 
operation is essentially invisible. 

The reconfiguration can cause a loss of data packets which 
have been previously queued on the link termination board 
handling the faulty link. It is necessary to ensure that the 
25 transmission of data packets via the faulty link has definitely 




11 

ceased before transmission is switched over to the other link, in 
order to guarantee the data packet sequence order. 

In an alternative embodiment, it is possible to use both the 
first link 33 and the second link 34 by using two different routing 
5 tag values with different translations, as long as both links are 
operational. That is, both of the links 33 and 34 can be 
operational in a normal mode until a link fault occurs, at which 
time only one link becomes operational. It is also contemplated in 
the present invention to implement two independent internal links 
10 on the same link termination board (for example 37) by providing 
the internal links with different data packet routing tags. 

Figures 4 and 4A illustrate the path of data packets from the 
devices 35 onto the links 33 and/or 34. Figure 5 illustrates the 
flow of data packets from the links 33 and/or 34 to a device 35. 

15 Since each connection is configured on both of the link 

termination boards 37 and 38, data packets arriving from links 33 
and/or 34 will automatically be forwarded to the destination 
device 35 from whichever link they are received. There is thus no 
need to inform the link termination boards 37 or 38 about the dual 

20 link state since the arriving data packets from the links 33 and 34 
will be destined for the appropriate device 35 regardless of the 
link from which they are received. Thus, no specific action is 
needed after a link fault in order to accommodate data packets 
being received from the active link into the devices 35. 

25 Of course, a switchover procedure from a first link to a 

second link must ensure that data packets in the ingress queue 




from the first link are forwarded to the destination device before 
data packets on the same user connections arrive via the second 
link. 

In accordance with the preferred embodiment of the present 
5 invention, both directions of data packet flow are relocated to 

another link when a fault is detected in one link, even if the fault is 
only in one direction. The invention is not limited to that 
preferred embodiment. 

Once a faulty link is repaired, traffic can be reverted back to 
10 the repaired link, again leaving the other link available as a 
backup. Alternatively, the set of interconnection links can be 
considered as a pool of links in which the identity of the active 
link carrying traffic is of no importance. In other words, once a 
switch occurs from use of a first link to use of a second link, 
15 traffic need not revert back to the first link until (and if) there is a 
subsequent failure in the second link. 

Various protocols are contemplated for when the 
changeover should occur following fault detection. It could be a 
requirement to state a maximum time to changeover on a fault, 
20 regardless of the type of fault. 

Figure 6 illustrates another aspect of an example 
embodiment of the present invention. There, switch modules 62, 
63, 64, and 65 are shown comprising a switch node between user 
60 and user 61. In accordance with the example embodiment of 
25 Figure 6, ATM switching is provided at the end-points, where 
users 60 and 61 are located. That is, switch module 62 and 65 




provide ATM switching. Between switch module 62 and 65, 
space switching is provided. 

While the invention has been described in connection with 
what is presently considered to be the most practical and preferred 
embodiment, it is to be understood that the invention is not to be 
limited to the disclosed embodiment, but on the contrary, is 
intended to cover various modifications and equivalent 
arrangements included within the spirit and scope of the appended 
claims. 



